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Abstract — In this paper two ways to compute singular values 
are presented which use Cholesky decomposition as their basic 
operation. 

I. Introduction 

Cholesky Decomposition is a fast and numerically stable 
matrix operation that finds wide use in various fields for 
linear system solving, inversion, and factorisation [1] and is a 
common block for matrix operations in hardware and software 
based computing systems. In this paper we present two ways 
of finding singular values of a matrix which use Cholesky 
decomposition as their basic operation, and may be useful 
in constrained computing environments such as embedded 
computing systems. 

The first method "Cholesky Iterations" uses Cholesky decom- 
positions based iterations |2), and fTU) . The second method 
uses Cholesky decomposition to compute the QR factors, 
which are further used for "QR Iterations" Q], Q, (5J, and 
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A. Cholesky Decomposition 

Cholesky Decomposition (TJ factorises a complex (or real- 
valued) positive-definite Hermitian symmetric matrix into a 
product of a lower triangular matrix and its hermitian trans- 
pose. 

A = R H R, or equivalently, R = chol(^4) 

where A E (j n ™ is a positive-definite Hermitian symmetric 
matrix, R 6 C nxn is an upper triangular matrix, and R H is 
the Hermitian tranpose of R. 

B. For Positive Semi-definite Matrices 

Cholesky decomposition for positive semi-definite matrices is 
analysed in p), and it is computed easily by setting the row 
to zero if the diagonal element is found to be zero. 

Algorithm 1 Cholesky Decomposition for Positive Semi-definite Matrix 

for i = 1... N do 

Ru = \J A u - J]fe=i R kiR* ki 
if \Rn\ > e then 

for j = i + 1...N do 

Rij = t^t \ — J2k=l RkjRkij 

end for 
else 

Ri,i+i...N = o 
end if 
end for 



In the algorithm above, instead of comparing the diagonal 
element with zero, we compare it against a small tolerance 
value e to account for numerical inaccuracies. 
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II. Cholesky Iterations 

In this section, "Cholesky Iterations" based computation of 
singular-values is discussed for positive (semi-) definite, sym- 
metric and arbitrary matrices. While the performance for pos- 
itive (semi-) definite and symmetric matrices are acceptable, 
the method for arbitrary matrices may have poor performance 
for ill-conditioned matrices. 

A. Positive (semi-) definite Matrices 

Let A G C nxn be a positive (semi-) definite Hermitian 
symmetric matrix, then the singular values (also eigenvalues) 
are given using the following algorithm. 

Algorithm 2 Cholesky Iterations - Positive (semi-) definite matrices 

J(°) = A 

for k := l...iter do 

J(k) =R (k) (R (k) ) H 

end for 

S = A = diag(j( itcr )) 
where 



diag(A) 



Aj 




if i=j 
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Singular values lie along the diagonals of the matrix S, and 
they are the same as eigenvalues. 
1 ) Diagonalisation: 
If 

j(k-l) = R H R 



then 



j(k) 



RJ^-^RT 1 = RR H 
and so the matrix is diagonalised as: 

J(k) = ( jR (*-l)... J R(l))j(0)(i J (fc-l)„.i J (l))-l 

The matrix product (R^^.-.R^) increases unboundedly 
with iterations, but the values of converge towards the 
diagonal singular-values matrix. 



B. Symmetric matrices 

Let A £ (7™ x ™ b e a Hermitian symmetric matrix, then the 
singular values (and eigenvalues) are given using the following 
algorithm. 



Algorithm 3 Cholesky Iterations - Symmetric Matrices 
J(°> = A + pi 

for k := l...iter do 

= cholCjO- 1 )) 

JW =R (k)( R (k)}H 

end for 

A = diag(j( itcr )) -fil 
E=|A| 



Where /i is a pivoting constant to ensure that the matrix is 
positive (semi-) definite matrix; /i may be found using variety 
of pivoting techniques, for e.g. see (7), ||8j, and |9j. 
If the symmetric matrix is well-conditioned, the algorithm 
given below for Aribtrary Matrices may also be used, which 
avoids the computation of the pivoting constants. 

C. Arbitrary Matrices 

Let A £ (j m ™ be an arbitrary matrix, then the singular values 
are given using the following algorithm. 

Algorithm 4 Cholesky Iterations - Arbitrary Matrices 
j(0) ~ A H A 

for k :— l...iter do 

i?( fe ) =chol(j( fe - 1 )) 

end for 

S = Vdiag(J( it01 ')) (or) diag(i?( iter )) 



If the matrix A is full row-rank, = AA H may also be 
used as an initial state for the iterations. 

III. QR Iterations 

In this section, Cholesky decomposition is used to compute the 
QR factors of an aribtrary matrix. These QR factors are further 
used for "QR Iterations" to compute the singular values. 
While computationally the method of finding QR factors from 
Cholesky decomposition may be expensive, its performance is 
acceptable and it may be advantageous to use this method in 
certain constrained computational platforms. 
If A £ C mxn is an arbitrary matrix, then the QR Decomposi- 
tion is given by: 



R = chol^A) (1) 
Q = AR- 1 (2) 

If A is not full-column rank, we may find Q as Q = AR + 
where R + is the pseudo-inverse of R. In that case, the last 
m — n columns of Q, and the lower m — n rows of R are 
zeros and may be ignored. 

Theorem III. 1 . Matrix Q = AR^ 1 is Unitary. 

Proof: We have A H A = R H R; pre-and-post multiplying 
with R~ H and Rr x , we have, R~ H A H AR^ 1 = I and so 
{AR- r ) H AR- 1 = I, or Q H Q = I, and hence Q is unitary. 



Algorithm 5 (Pure) QR Iterations 

J(°) - A 

for k := L.iter do 

i?« =chol((j( fe ^ 1 )) ff j(' £ - 1 )) 

Q(fc) = J(fc-l) 
JW = R(VQ(k) 
end for 

S = diag(j( itor )) 



For further information on"QR Iterations" refer |TJ, Q, |5), 
and ©. 
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